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Abstract 

Theta correspondence 9 over R is established by Howe in ( [7]). In ^2]i we prove that 8 
preserves unitarity under certain restrictions, generalizing the result of Jian- Shu Li ( |19j). 
The goal of this paper is to elucidate the idea of constructing unitary representation through 
the propagation of theta correspondences. We show that under a natural condition on the 
sizes of the related dual pairs which can be predicted by the orbit method ( [21], |31| . 
|21|^ . one can compose theta correspondences to obtain unitary representations. We call 
this process quantum induction. 

1 Introduction 

An important problem in representation theory is the classification and construction of ir- 
reducible unitary representations. Let G be a reductive group and n(G) be its admissible 
dual. For an algebraic semisimple group G, the admissible dual 11(G) is known mostly due 
to the works of Harish-Chandra, R. Langlands, and Knapp-Zuckerman (see ^7], 
Let IT U (G) be the set of equivalence classes of irreducible unitary representations of G, of- 
ten called the unitary dual of G. The unitary dual of general linear groups is classified 
by Vogan (see (221)- The unitary dual of complex classical groups is classified by Bar- 
basch (see [2]). Recently, Barbasch has classified all the spherical duals for split classical 
groups (see 0). The unitary duals H u (0(p, q)) and Tl u (Sp2 n (M.)) are not known in general. 

In jS] , Roger Howe constructs certain small unitary representations of the symplectic group 
using Mackey machine. Later, Jian-Shu Li generalizes Howe's construction of small unitary 
representations to all classical groups. In particular, Li defines a sesquilinear form (, ) n that 
relates these constructions to the theta correspondence (see EH])- It then becomes clear 
to many people that some irreducible unitary representations can be constructed through 
the propagation of theta correspondences (See [201 ^ [D] an d EU an d the references within 
them). So far, constructions can only be carried out for "complete small orbits" (see |20|1. 
The purpose of this paper is to make it work for nilpotent orbits in general, for real orthog- 
onal groups and symplectic groups. 

Consider the group 0(p,q) and 5p2n(R)- The theta correspondence with respect to 

0(p,q)^Sp 2n (R) 
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is formulated by Howe as a one-to-one correspondence 

9(p,q;2n) :K{MO{p,q),w(p,q;2n)) K(MSp 2n (R),u{p,q; 2n)) 

where MO(p,q) and MSp 2n (^) are some double coverings of 0(p,q) and 5*p2n(K) respec- 
tively and 

K(MO(p,q),u(p,q;2n)) C n(MO(p,?)); ft(MSp 2n (R), w(p, g; 2n)) C Il(MSp 2n (R)) 

(see [7]). We denote the inverse of 9(p, q; 2n) by d(2n;p, q). For the sake of simplicity, we 
define 

9{p,q;2n)(ir) = 

if 7r ^ 1Z(MO(p, q),u)(p, q;2n)). We define 6{p, q; 2n)(0) = and can be regarded as the 
NULL representation. 

For example, given an "increasing" string 

0( Pl , qi ) -> Sp 2ni (M.) -» 0( P2 ,g 2 ) -> Sp 2n2 (M.) ^2„ m (K) -► 0(p m ,q m ) 

Pi + Qi =P2 + Q2 = ■■■ =Pm + q m ( mod 2), 
consider the propagation of theta correspondence along this string: 

9(2n m ;p m , q m ) . . . 9(2m;p 2 , %i)0(pi,qi; 2n{)(ir). 

Under some favorable conditions on ir € H u (0(pi, qi)), one hopes to obtain a unitary 
representation in Tl u (0(p rn , q m ))- In this paper, we supply a sufficient condition for 

0(2n m ;p m ,q m ) . . . 6(2m;p 2 , ?2)0(pi, qii 2ni)(n) 

to be unitary. We denote the resulting representation of MO(p m , q m ) by 

Q{px,qi; 2nr-.pi, q 2 , 2n 2 ; . . .;p m , q m ){^)- 

We call Q(p\, qi] 2n\;p 2 , q 2 ; 2n 2 ; . . . ;p m , q m ) quantum induction. In addition to the assump- 
tion that certain Hcrmitian forms do not vanish, we must also assume the matrix coefficients 
of 7r satisfy a mild growth condition. 

Based on the work of Przebinda ( [23]). we further determine the behavior of infinitesi- 
mal characters under quantum induction. In certain limit cases, the infinitesimal character 
under quantum induction behaves exactly in the same way as under parabolic induction. In 
fact, in some limit cases, quantum induced representations can be obtained from unitarity- 
preserving parabolic induction (see Finally, motivated by the works of Przebinda 

and his collaborators, we make a precise conjecture regarding the associated variety of the 
quantum induced representations (Conjecture 2). 

There is one problem we did not address in this paper, namely, the nonvanishing of certain 
Hermitian forms with ir E H(Mp 2n (M)). In a forthcoming article ( we partially 

address this problem and construct a set of special unipotent representations in the sense 
of Vogan (see jHOl)- I wish to thank Prof. Shou-En Lu for her encouragements and the 
referee for some very helpful comments. 
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2 Main Results 



2.1 Notations 

In this paper, unless stated otherwise, all representations are regarded as Harish-Chandra 
modules. This should cause no problems since most representations in this paper will be 
admissible with respect to a reductive group. Thus unitary representations in this paper 
would mean unitrizable Harish-Chandra modules. "Matrix coefficients" of a representation 
7r of a real reductive group G will refer to the K-Hmte matrix coefficients with respect to a 
maximal compact subgroup K . A vector v in an admissible representation tt means that v 
is in the Harish-Chandra module of it which shall be evident within the context. 

Let (Gi, G 2 ) be a reductive dual pair of type I (see [7j The dual pairs in this paper 

will be considered as ordered. For example, the pair (0(p, q), Sp 2n (^-)) is considered differ- 
ent from the pair (Sp2n{^), 0(p, q)). Unless stated otherwise, we will, in general, assume 
that the size of G\(V\) is less or equal to the size of G2(V2), i.e., dim£>(Vi) < dim£>(V2). Let 
(Gi, G2) be a dual pair in the symplectic group Sp. Let Mp be the unique double covering 
of Sp. Let {1, e} be the preimage of the identity element in Sp. For a subgroup H of Sp, let 
MH be the preimage of H under the double covering. Whenever we use the notation MH , 
H is considered to be a subgroup of certain Sp which shall be evident within the context. 
Let w(¥Gi, MG2) be a Schrodinger model of the oscillator representation of Mp equipped 
with a dual pair (MGi, MG2). The Harish-Chandra module of oj(MGi, MG2) consists of 
polynomials multiplied by the Gaussian function. Since the pair (Gi,G2) is ordered, we 
use 9(MG 1 ,MG 2 ) to denote the theta correspondence from 1l{MG 1 ,u}{MG 1 , MG 2 )) to 
1Z(MG2, uj(MGi, M G2)). We use n to denote the constant vector 

(n,n, ...,n) 

The dimension of n is determined within the context. Finally, we say a vector 

x = (xi,x 2 , ■ ..x n ) -< 

if 

k 

^2 Xj < Vfc > 1 

3=1 

and x ^ if 

k 

^Xj<0 Vfc>l. 

3=1 

In this paper, the space ofmxn matrices will be denoted by M(m,n). The set of non- 
negative integers will be denoted by N. For the group 0(p, q), we assume that p < q unless 
stated otherwise. For a reductive group G, n(G), n u (G) will be the admissible dual and 
the unitary dual respectively. 

We extend the definition of matrix coefficients to the NULL representation. The matrix 
coefficients of the NULL representation is defined to be the zero function. 
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2.2 Theta Correspondence in Semistable Range and Unitary Rep- 
resentations 

Let 7r S LT(AfGi). Following JU], for every u, v S ir and 0, ^ S w(MGi, MG2), we formally 
define 

(</> ® v, V ® w)* = / (w(A//Gi,MG 2 )(gi)0,^)(w,7r(g 1 )w)dgi. (1) 
Roughly speaking, if the functions 

{w{MG u MG 2 ){g x )4>,^){u,Tr{9i)v) (V<^V e w(MGi,AfG 2 );Vu,« € tt) 

are in i 1 (A/Gi) and 7r(e) = —1, 7r is said to be in the semistable range of 9(MG\, MG2) 
(see IHj). We denote the semistable range of 9(MG 1 ,MG 2 ) by n s {MG u M G 2 ). 

Suppose from now on that tt £ 1Z s (MGi, MG2). In [TJ]|, we showed that if (, ) n 
does not vanish, then (, ) 7r descends into a Hermitian form on 6{MG\, MGi)(ir). For 
tt e K s {MGi,MGi), we define 

^.(MG.MGOW = { ^ MG ^f G ^) I (0^0 (2) 

9 s (MGi, MG2){tt) as a real vector space is just w(AfGi, M G2) <8 7r modulo the radical of 
(, )tt (see [T^], The main object of study in this paper is 9 S . 

If tt is in K S (MG 1 ,MG2) but not in 1Z(MGi , lj (MGi , MG2)) , our construction from [HI 
will result in a vanishing (, )„•. Thus 9 s (MGi, M G2){^) "vanishes" . In this case, 9 S = 9 triv- 
ially. The remaining question is whether (, ) 7T 7^ if 7r G 1Z(MGi, us(MG\, MG2)). Conjec- 
turally, 9 s {MGi 7 MGi) should agree with the restriction of 0(MGi, MGi) on 7£ s (MGi , MG%) 
(see HO], BS|). 

For 7r a Hermitian representation, it can be easily shown that (, ) ff is an invariant Hermitian 
form on 6{MG\, MG^Xtt) if (, ) w does not vanish. This is a special case of Przebinda's 
result in ( |25|b For 7r unitary, we do not know whether (, ) 7r must be positive semidefinite 
in general. Nevertheless, in |12j . we have proved the semi-positivity of (, ) 7T under certain 
condition on the leading exponents of tt (see JH], [H2])- Fix a Cartan decomposition for 
5p2ri(R) and 0(p,q). Fix the standard basis of a for Sp2n(^) and 0(p,q) (see 6.1). The 
leading exponents of an irreducible admissible representation are in the complex dual of the 
Lie algebra a of A. 

Theorem 2.2.1 Suppose p + q < 2n + 1. Let n be an irreducible unitary representation 
whose every leading exponent satisfies 

n(v)-(n-V±^)+p(O(p,q))<0 (3) 

Then (, )„. is positive semidefinite. Thus, 9 s (j>, q; 2n)(7r) is either unitary or vanishes. 

We denote the set of representations in U(MO(p,q)) satisfying (|3J| by lZ SB (p,q;2n). The 
set lZ s (MO(p, q), MSp2n(^-)) is written as lZ s (p, q; 2n) in short. 

Theorem 2.2.2 Suppose n < p < q. Let -k be an irreducible unitary representation whose 
every leading exponent satisfies 

n(v)-(^^-n-l)+p(S P2n (R))^0 (4) 
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Then (, ) lr is positive semidefinite. Thus, either 9 s (p, q] 2n) s (7r) is unitary or vanishes. 

We denote the set of representations in U(M Sp2n{R)) satisfying (0J by lZ ss (2n;p,q). The 
set lZ s (MSp2n(S-), MO(p, q)) is written as TZ s (2n;p, q) in short. 

2.3 Estimates on Leading Exponents and L(p,n) 

In this paper, we establish some estimates on the growth of the matrix coefficients of 
9(p,q;2n)(ir) and of 8(2n;p,q)(w) for ir in H s (p, q;2n) and TZ s (2n;p,q) respectively. We 
achieve this by studying the decaying of the function 

L(a,cj))= ( TT (a? + b 2 j yi)<j}{b 1 ,b2,...,b p )db 1 db 2 ...db p 

Jb 1 >b 2 ...>b p >i i=lj=1 

as a function of a S 1™. In general, the decaying of L(a, cj>) depends on the decaying of </>. 
In section 5, we define a map L(p,n) to describe this dependence. The map L(p,n) is a 
continuous map from 

C(p) = {A -< | A e R p } 

to 

C(n) = {fi -< | ^ € K"} 

Its algorithm is developed in Section 5. For some special vectors in C(p), L(p,n) is just a 
reordering plus an augmentation or truncation. In this paper, we prove 

Theorem 2.3.1 . Let L(n,p) be defined as in Section 5. Let a{g 2 ) be the middle term of 
the KA + K decomposition of g 2 S Sp2n(J&)- Let &(<?i) be the middle term of the KA + K 
decomposition of gi S 0(p,q). 

1. Suppose that ir 6 lZ s (p,q;2n). Suppose A -< — 2p(0(p, q)) + n and for every leading 
exponent v ofir, $t(v) ^ A. Then the matrix coefficients of s (p, q; 2n)(7r) are weakly 
bounded by 

a ( 92 )MP,«)(*+2p(0(p,<?))-n)-a§E _ 

,2. Suppose that ir € lZ s (2n;p 7 q). Suppose A -<; -2p(Sp 2n (R)) + E | a and /or every leading 
exponent v of n, ^ A. T/ien f/ie matrix coefficients of 9 s (2n;p,q)(jr) are weakly 

bounded by 

The definition of weakly boundedness is given in Section 3. 

2.4 Quantum Induction 

The idea of composing two theta correspondences to obtain " new" representations has been 
known for years. For example, one can compose 9{p, g; 2n) with 8(2n;p' ', q'). The nature of 
9(2n;p' ,q')0(p,q;2ri)(n) seems to be inaccessible except for the cases of stable ranges. In 
this paper, we treat a somewhat more accessible object, namely, 

6 s (2n;p',q')e s (p,q;2n)(ir). 

Our construction is done through the studies of the Hermitian form (, )„■. Due to the 
unitarity theorems we proved in ( \12\). under restrictions as specificed in Equations ( EJ) 
and (0J), quantum induction preserves unitarity. Our main result can be stated as follows 
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Theorem 2.4.1 (Main Theorem) • Suppose 

1. q' >p' > n; 

2. p' + q' - 2n > 2n- (p + q) + 2 > 1; 

3. p + q = p' + q 1 ( mod 2). 

Let 7r be an irreducible unitary representation in 1Z ss (p, q; 2n). Suppose that (, ) OT does 
not vanish. Then 

1. 6 s {p, q; 2ri)(n) is unitary. 

2. 6 s (p,q;2n)(n) G K ss (2n;p',q'). 

3. 9 s (2n;p',q')9 s (pi,q;2n)(Tr) is either an irreducible unitary representation or the 
NULL representation. 

• Suppose 

1. 2n' - p - q + 2 > p + q - 2n; 

2. n < p < q. 

Let it be a unitary representation in lZ ss (p, g; 2n). Suppose (, ) 7r does not vanish. Then 

1. 9 s (2n;p,q)(Tr) is unitary. 

2. 6 s {2n;p,q){n) G K ss (p,q;2n'). 

3. 6 s (p,q]2n')6 s (2n;p,q){%) is either an irreducible unitary representation or the 
NULL representation. 

The purpose of assuming 7r G 1Z SS is to guarantee the unitarity of Q(*)(ir). In fact, for 
any n, the condition on the sizes of related dual pairs can be computed easily to define 
nonunitary quantum induction. In general, the underlying Hilbert space of the induced 
representation is "invisible" under quantum induction except for certain limit cases where 
quantum induction becomes unitary parabolic induction (see Section 6 and 

Conjecture 1 Suppose n is a unitary representation in 7Z SS . 

• The quantum induction Q(p, q; 2n;p' , ?')(7r) for 2n — p — q + 2 = p' + q' — 2n can be 
obtained via unitarity-preserving parabolic induction and cohomological induction from 

K. 

• The quantum induction Q{2n;p, q; 2n / )(n) for p + q — 2n — 2 = 2n' — p — q can be 
obtained as a subfactor via unitarity-preserving parabolic induction from ir. 

For the cases p + q = 2n + 1 = p' + q' and p + q = 2n + 1 = 2n' + 1, by a Theorem 
of Adams-Barbasch, Q is either the identity map or vanishes ( pQ). Our conjecture holds 
trivially, i.e., no induction is needed. For the case p + q + p' + q' = 4n + 2andp— p' = q — q', 
our result in Section 6 gives some indication that Q(p, q; 2n;p', g')( 7r ) can be obtained from 

Tr)f lSO (p',q>) CttSSFi 
lna SOo(p,q)GL (p>-p)N\ n ^ L >' 

Let me make one remark regarding the nonvanishing of (, ),r. In we prove 

Theorem 2.4.2 ( |llp Suppose p + q < 2n + 1. Let n G 7£ s (p, q; 2n). Then at least one 
of 

G )t) G )w®det 

does not vanish. 
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For tt £ lZ s (2n;p, g), the nonvanishing of (, ) 7T is hard to detect since it depends on p, q ( pQ, 
H3, EU)- A result of Jian-Shu Li says that (, ) T does not vanish if p, q > 2n. We are not 
aware of any more general nonvanishing theorems. 

Finally, concerning the associated varieties, Przebinda shows that the associated varieties 
behaves reasonably well under theta correspondence under certain strong hypothesis ( |24| "> . 
We conjecture that quantum induction induces an induction on associated varieties and 
wave front sets. The exact description of the associated variety under quantum induction 
can be predicted based on 

Conjecture 2 • Under the same assumptions from the main theorem, letir be a unitary 
representation in TZ ss (j>, q; 2n). Let Od be the associated variety oj it with d a partition 
(see Ch 5, U\). Let Of be the associated variety of Q(p, q; 2n;p', g'X 71 ") 7^ 0- Then 
f* = {p' +q' -2n,2n-p- g,d*). 

• Under the same assumptions from the main theorem, let tt be a unitary representation 
in lZ ss {2n;p,q). Let O& be the associated variety of tt with d a partition. Let Of be 
the associated variety ofQ(2n;p,q;2n')(ir) ^ 0. Theni* — (2n' — p — q, p + q — 2n, d*). 

We remark that our situation is different from the situation treated in [22] with some 
overlaps. The description of the wave front set under quantum induction can be predicted 
based on |2T] . 

3 Theta Correspondence 

Let {0(p, g), Sp2n(M)) be a reductive dual pair in Sp2 n (p+q) (K). Let 

j ■ Mp 2n{p+q) (R) -> Sp 2n{p+q) (R) 

be the double covering. Let {1, e} = Let MO(p, q) = j~ l {0(p, g)) and MSp 2n (^) = 

j~ 1 (Sp2n(^))- Fix a maximal compact subgroup U of Sp2 n (p+q) (K) such that 

U n Sp 2n (M.) £* U(n), U n 0(p, q) £* 0(p) X 0{q). 

Then MU is a maximal compact subgroup of Mp 2n ( p + q ) (K). Let u(p, q; 2n) be the oscillator 
representation of Afp 2 n(p+ 9 ) The representation iv(p,q;2n) or sometimes ui(2n;p,q) 
is regarded as an admissible representation of Mp 2n ( p + 9 )(K) equipped with a fixed dual 
pair (0(p, q),S P 2 n (B.)). Let "P be the Harish-Chandra module. Then uj(p,q;n) can be 
restricted to MO(p,q) and MSp2n{^)- Howe's theorem states that there is a one to one 
correspondence 

0(p, q; 2n) : K(MO(p, g), w(p, g; 2n)) -> ^(M5pan(R),o;(p, g; 2n)). 
3.1 MO(p,q) and M,Sj9 2n (R) 

The groups MO(p, q) and MSp2n(lR) are double covers of 0(p, g) and 5p2n(K). Depending 
on the parameter n, p and q, they may be quite different. 

Lemma 3.1.1 

1. If p + q is odd, then the double cover MSp2n(M) does not split. It is the metaplectic 
group M P 2 n (M). The representations in lZ(M P 2 n (M),u(p,q;2n)) are genuine repre- 
sentation of M P 2 n (K) • 
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2. If p + q is even, then the double cover MSp2 n (J&) splits. It is the product of Sp2 n (M.) 
and {l,e}. The representations in TZ(MSp2n(M),u{p,q]2n)) can ^e identified with 
representations of Sp2n(7H) by tensoring the nontrivial character o/{l,e}. 

3. In both cases, any representation in 

TZ(MS P 2 n (M.),uj(p,q;2n)) 

can be identified with a representation of Mpan (M) ■ I n the former case, a genuine 
representation, and in the latter case, a nongenuine representation. 

We do not know the earliest reference. The details can be worked out easily and can be 
found in £Q. 

Lemma 3.1.2 

1. As a group, 

MO(p,q)^{(£,g)\g€0(p,q),e = detg"} 

2. £ is a character of MO(p,q). Any representations inTZ(MO(p,q),Lu(p 1 q;2n)) can be 
identified with representations of 0(p, q) by tensoring £. 

3. MSO(p,q) can be identified as group product 

SO(p,q)x{l,e}. 

4- If n is even, MO(p,q) = 0{p,q) x {1, e}. 
The details can be found in pQ or ^21- We must keep in mind that for p + q odd, 

genuine (AfpanW) 

and for p + q even 

K{MSp2„{M),u(p,q;2n)) cU{Sp 2 „(M.))- 
3.2 Averaging Integral (, ) 7r 

Let 0(p, q) be the orthogonal group preserving the symmetric form defined by 

P I p 

Ip,q — I Iq—p 



i P o o p 



Fix a Cartan decomposition with 



q-p 

A = { diag(ai,a 2 , . . . , a p , 1, . . . , 1, a^ 1 , a^ 1 , . . . , a" 1 ) | a* > 0} 
and a positive Weyl chamber 

q-p 

A + = { diag(ai, a 2 . . . , a p , 1, . . . , 1, , ■ ■ ■ , a~ x ) | a\ > a 2 > . . . > a p > 1}. 

The half sum of the positive restricted roots of 0(p, q) 



fnt w (P + 1- 2 P + q-4: q-Ps 
P(0(p,q)) = ( ^ , ^ ,...,——). 



8 



Let Sp2 n (R.) be the symplectic group that preserves the skew-symmetric form defined 

Let K be the intersection of Sp2n(R) with the orthogonal group 0{2n) which preserves the 
Euclidean inner product on R 2 ". Let 

A = {a = diag(ai, a 2 , . . . , a„, a^ 1 , . . . , a" 1 ) \ a* > 0} 

A + = {a = diag(ai, a 2 , . . . , a n , aj" 1 , . . . , a" 1 ) | a\ > a 2 > . . . > a„ > 1}. 
The half sum of the positive restricted roots of <Sp2n(R) 

n 

p{S P 2n{m) = (n,n-l,...,l). 

For each irreducible admissible representation of a semisimple group G of real rank r, 
there are number of r-dimensional complex vectors in a* called leading exponents attached 
to it. Leading exponents are the main data used to produce the Langlands classification 
(see [H] and 

Definition 3.2.1 An irreducible representation tt of 0(p,q) is said to be in the semistable 
range of 9(p, q\ 2n) if and only if each leading exponent v of tt satisfies 

3 

^2$i(v l ) + (p + q-2i)-n<0 (Vje[l,p]) (5) 

i=i 

i.e., 

$l(v)-n + 2p(0(p,q)) -< 0. 

An irreducible representation tt of Mp2 n (M.) is said to be in the semistable range of 9{2n;p, q) 
if and only if every leading exponent v of tt satisfies 

k 

+ 271 + 2- 2j<0 (V ke[l,n]) ( 6 ) 

i=l 

i.e., 

- + 2p(5p 2n (M)) -< 0. 

If W is a complex linear space, we use a superscript W c to denote W equipped with the 
conjugate complex linear structure. Let tt G TZ S (MG\,MG2)- We define a complex linear 
pairing 

(V c <g> tt, P ® tt c ) -> C 
as follows: for <fi G V , "0 G P , u G 7r c . u G tt. 

{<f> <g) u, r/» ® u)tt = / (<j),uj(g)ip)(ir(g)u,v)dg 

JMO(p,q) 

If 7T is unitary, (, ) w is an invariant Hermitian form with respect to the action of MG%. 
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Theorem 3.2.1 (see JWf) Suppose (w,V) is a unitary representation in the semistable 
range of 6(MGi, MG%). Then is well-defined. Suppose TZ„ is the radical of (,)„ with 
respect to V ®V C . If (, ) n does not vanish, then 

• 7T occurs in K(MGi,lu(MGi, MG 2 )); 

• V <B> V c /TZ n is irreducible; 

• V<S>V c /TZ 7r is isomorphic to 6(MGi, MG 2 )(tt). 

• 9 S {MG\, MG2){t{) is a Hermitian representation of ' MG2. 

Thus the Harish-Chandra module of 8 S (MG\, MG^)^) can be defined as V ® V c /TZ V . 
3.3 Oscillator Representation 

The oscillator representation, also known as the Segal-Shale- Weil representation, is a unitary 
representation of the metaplectic group Mp. The construction of the oscillator representa- 
tion can be found in the papers of Segal, Shale and Weil ( |2£1, [23 , EH])- I n this section, 
we give a basic estimate of the matrix coefficients of the oscillator representation. Proof of 
Theorem 3.3.1 can also be found in 6 (Prop. 8.1). 

Let g £ 5/?2n(K). Let a(g) be the midterm of the KAK decomposition of g such that 
aeA + . Let H(g) = \oga\g). Then 

H{g) = diag(ffi(g), H 2 (g), ...,H n (g), -H^g), . . . , -H n {g)) 

is in the Weyl chamber a + . 

Let Mp2«(K.) be the double covering of Sp2n(^)- The midterm of the KAK decompo- 
sition of Mp2n(K) remains the same. Let (ui n , L 2 (]R™ ) ) be the Schrodinger model of the 
oscillator representation of Mp2 n {^) as in ^U]. Let 

H{x) = exp(--(xl + x\ + . . . + xl)) 

be the Gaussian function. The Harish-Chandra module V n are the polynomial functions 
multiplied by the Gaussian function as verified in jl(J|. We write 

n 

x°< = l[x?. 

1 

Harish-Chandra's theory says that the Mp2«(R) action on V n can be controlled by the A 
action on fixed if- types of u n . 

Theorem 3.3.1 For any a £ A, we have 

(uj n (a)x a fj,(x),x fi(x)) = c« :/3 JJa"* + 2(l + af) z ~2^~ 

i=l 

In addition, 

n 

\(oj n {a)x a n(x),x^fx(x))\ < c\{(a l + ar 1 )-h 

i=i 
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In general, for every 0, tp G Pn, we /mve 

n 

\{u n {g)<i>,i>)\ < cH( ai (g) + ar\g))-i 

i=l 

The proof for the first statement can be found in ^Uj. We observe that 
\(u) n (a)x a fi(x),x P fi(x))\ 

n 

=\c a jH<? + *{i+<t)- si± * ±L \ 

i=l 

n 
i-1 

The second statement is proved. The third statement follows immediately from if-finiteness 
of <j) and ip. 

The estimations on the right hand side are invariant under Weyl group action, thus do 
not depend on the choices of the Weyl chamber a + . 

3.4 Growth of Matrix Coefficients 

Definition 3.4.1 Suppose X is a Borel measure space equipped with a norm ||.|| such that 

• INI > for all x G X; 

• the set {|| a; || < r} is compact. 

Let f(x) and 4>{x) be continuous functions defined over X . Suppose <fi(x) approaches as 
\\x\\ — > oo. A function f{x) is said to be weakly bounded by the function <j){x) if there exists 
a Sq > such that for every S > 5 > 0, there exists a C > depending on S such that 

\f(x)\ < C^x) 1 - 5 (VxeX) 
The typical case is when f(x) does not decay as fast as (f>{x) but faster than (^{x) 1 ^ 5 . 

Let 7r be an irreducible representation of a reductive group G. Let if be a maximal compact 
subgroup of G. We adopt the notation from Chapter VIII in JS]. We equip G with a norm 

g -> || log(a(g))|| = (loga0),loga(s))5 

where (, ) is a real g-invariant symmetric form whose restriction on a is positive definite. 

Example: An irreducible representation 7r of a reductive group G is tempered if and only 
if its matrix coefficients are weakly bounded by 

where p is the half sum of positive restricted roots and a (g) is the mid term of the KAK 
decomposition with a(g) in the positive Weyl chamber A + (see |15p. 
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Theorem 3.4.1 Let tt be an irreducible unitary representation of G. Let A -< 0. The 
following are equivalent. 

1. Every leading exponent v of n has SR(u) ^ A. 

2. There is an integer q > such that every K-finite matrix coefficient is bounded by a 
multiple of {I + || \oga(g)\\) q cxp(A(loga(g))). 

3. Every K-finite matrix coefficient (p(g) of n is bounded by Ca(g) x+S for any S >~ 0. 
4- Every K-finite matrix coefficient of ir is weakly bounded by a(g) x . 

See Chapter VIII. 8, 13 15 or Chapter 4.3 [32] for details. The first three statements are 
equivalent without assuming the unitarity of ir and A -< 0. 

4 Twisted Integral 

Let A + = {ai > a-i ■ . . > 1}. In this section, we will study the following integrals 

„ V n 

L(a,X)= / H(Yl(al + ^r^dbi 
Jb+ i=i fc=i 

and 

L(a,4>)= I T\{a 2 l +b)y^-(t>{b 1 ,b2,...,b p )db 1 db2---db p . 

Jb 1 >b- 2 ...>b p >i it - 

The domain of a will always be A + unless stated otherwise. We are interested in the growth 
of L(a,(j>) as a goes to infinity. Variables and parameters are assumed to be real in this 
section. 

4.1 Single Variable Case a > 1 
Lemma 4.1.1 Suppose that a > 1. The integral 

L(a,\)= f {a 2 + b 2 )-h x db 

Jb>l 

converges if and only if A < 0. In addition, L(a, A) is weakly bounded by a x if —1 < A < 
and is bounded by a multiple of a^ 1 if A < — 1. 

Proof: From classical analysis, the integral 

/ b- 1+x db 

Jb>l 

converges if and only if A < 0. For a fixed a and any b > 1, b 2 < a 2 + b 2 < (1 + a 2 )b 2 . Hence 
f b^b x db> [ (a 2 + b 2 yh x db> [ (1 + o 2 )-'6 _1 b A d6 

Jb>l Jb>l Jb>l 

Hence, L(a, A) converges if and only if A < 0. 
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For a > 1 



L{a,X)=[ (a 2 + b 2 yh x db 



Jb>l 



Jab>l 



[ (a 2 + a 2 b 2 )-^a x+1 b x db 



=a x [ (l + b 2 )-h x db 



(8) 



=a x f (l + b 2 )-h x db + a x f 



(i + b 2 )-h x db 




For a > 1 and a 1 < b < 1 and A ^ — 1, 



-^6 A < (l + & 2 )-5^ 



Taking J a _ ± db, we obtain 



V2(A + 1) 




Therefore, for — 1 < A < 0, L(a,X) is bounded by a multiple of a x ; for A < —1, L(a, A) is 
bounded by a multiple of a -1 . For A = — 1, 



Therefore, L(a, —1) is weakly bounded by a x . Q.E.D. 

Lemma 4.1.2 Suppose A < 0. Suppose f(a) is weakly bounded by a x for any > A > A . 
Then f(a) is weakly bounded by a Xa . 

Combining these two lemmas, we obtain 

Theorem 4.1.1 Suppose that a > 1. Suppose (f>(b) is weakly bounded by b x for some A < 0. 
Then the integral 



converges. In addition, L(a,<f>) is weakly bounded by a x if — 1 < A and is bounded by a 
multiple of a^ 1 if X < — 1. 

In conclusion, the growth rate of L(a, <^(6)) is a "truncation" of the growth rate of 4*{b). 
4.2 Multivariate b 

Let A = (Ai, A 2 , . . . , A p ). Let B + = {bi > b 2 > . . . > b p > 1}. Let us consider 






p 
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First, we observe that 

a 2 + b?>a 2 ^b*- 2 ^ 



for any r\i e [0, 1]. The rji is to be determined later. We obtain 

L(a,X)<[ f]a- r nr 1+ ^db t 
Jb+ ~7 



V 

1+TJi + A, 



Secondly, we change the coordinates and let 



n = -p- (i = i,...,p-i) 

Oi+l 



Tp — hp . 



Then 

p 

6i ^ri r J (*= i .---if > )- 

In addition, B + is transformed into [l,oo) p . The differential 



(9) 



■t ... 1 1 . • i 

l—l l—l J— I l — l 

We obtain 

L(a,\)<a-^" [ f[bf +x ^ 
J[i,oc)p fJi n 

=«- e W ^ n(frr A ^ do) 

J[i,oc)p i=1 1=t r t 

This integral converges if 

i 

5^fh + Aj<0 (Vj). 
»=i 

Theorem 4.2.1 Suppose a > 1. If X -< 0, then L(a,X) converges. Furthermore, L(a,X) is 
bounded by a multiple of 

with any r]i satisfying the condition 

3 3 

{o < vj < i, * + S Xi < ( - ? = x » ■ ■ 

1=1 1=1 
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The condition 

3 j 

i=l i=l 

can be restated as 77 + A -< 0. Combined with Lemma 14.1.21 we have 

Theorem 4.2.2 Suppose (f>(bi, 62, ■ ■ ■ , bp) on B + is weakly bounded by b x for some A -< 0. 
Then the function 

r P 

Ha, <j>) = / (TT(a 2 + &?)-*)0(6)d&i ...db p 
Jb+ tl 

is weakly bounded by with 

p 

fi = maxj^J rji j < r/j < 1, A + 77 < 0}. 

i=l 

We point out the second ingredient needed to carry out estimations on L(a, 4>), namely, the 
coordinate transform from b to r. 

4.3 Multivariate a G [1, 00)" 

This case is more complicated since the function L(a, <fi) is no longer of single variable. Our 
result here is weaker than the results for single variable a. 



First we consider 

p n 



/P n 
j+ i=i k=i 



We again set the parameters i]k,i to be in [0, 1]. We have 



al + bf>al Tlk ^- 2r "" i 



Therefore, we obtain 



L(a, A) 

p n 



(ii) 



fc=i " J+ i=i 



1I", N; "■ / IK " <a 



Now we change the coordinates b into r. We obtain 
L(a, A) 



-iw-'-"- / ^(n^-^^^)^ (12) 

fe =i fc h,oo)' j=1 3 r J 



k=l -[l,o°) p i= l j=j " r 

p 
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This integral converges if 

j n 

! + <0 ( V 

i=l fe=l 

Since G [0, 1], we obtain the following theorem. 

Theorem 4.3.1 Suppose a G [l,oo) p . The integral L(a,X) converges if 

3 

i=i 

for every integer 1 < j < p. In this situation L(a, A) is bounded by a multiple of 

k=i 

where /J, k = Yh=i Vk,i and {n k ^} satisfy 

g [0,1] Vfc.i 



J2(^-n + l + J2^,i) <0 V j. (13) 

i=l fc=l 

Similarly, we obtain 

Theorem 4.3.2 Suppose a G [l,oo) p . Suppose <f)(b)b~ n+1 on B + is bounded by b x with 
A -< 0. T/ien £/ie integral L(a, (j)) converges. Furthermore, L(a, </>) is bounded by a multiple 
of 

C - 1 I „-«. 



n 



fc=i 



w/iere = Y%=i Vk,i and {r) k j} satisfy 

Vk,i e [0,1] Vfc.i 



j>i + I>,i)<0 V j. (14) 
i=i fe=i 



5 Algorithm and Examples 

Suppose A -< 0. We are interested in finding the "maximal" rj where 

p 

1=1 

with r//; ; j satisfying 



G [0, 1] Vfc, i 

I>i + X>,i)<0 V j. (15) 



i=i fe=i 
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5.1 A Theorem for a G [l,oo) n 
Write (Unj) as 

j n j 

i=l fc=l 2=1 

First of all, since r?fc,i > 0, the sequence 

j n 

{EE^i^M} 

i=i fe=i 

is increasing. However, the sequence 

{-^>|je[l, P ]} 

i=l 

might not be increasing. Therefore, there are redundancies in Inequalities ^] Let j\ be 
the greatest index such that 

ji i 

-Ai = min{- ^ A, | j G [l,p]} 

i=l i=l 

Then we consider j > ji . Let ji be the greatest number such that 

h j 

= min{-^A 4 | j £ [ji,p]}. 
i=l i=i 

If j2 = jii we stop. Otherwise, we can continue on and define a sequence 

jo = < ji < 32 < h < ■ ■ ■ < P 

with 

31 h v 

0<^-A i <^-A i <...<^-A i . (17) 

i—1 i—1 i—1 

Our problem is equivalent to finding {ijk.i} such that 

Vk.i e [o, i] Vfc, i 

is n 

X)(Ai+X)»?M)<0 (V j.). 
i=i fe=i 

Once we determine the sequence 

jo = < ji < ji < j 3 < ■ ■ ■ < P, 
we assign numbers in [0, 1] to r]f.,i for j s _i < i < j s such that 

js Tb j s 

£5>m<-X>- as) 

i=l fe=l i=l 
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Theorem 5.1.1 Suppose a £ [l,oo) p . Suppose <fi(b)b n+1 on B + is bounded weakly by b x 
with A -< 0. Then the integral L (a, 4>) converges. Furthermore, L(a,4>) is weakly bounded by 

k=l 

where = X)f=i 7 lk,i and for each j s > 0, {r)k,i G [0, 1]} satisfy one of the following 
1. 



£>.• + $>*,<) = °; (is) 



1=1 fe=l 

2. 



Z( Ai +5^^) < 0; *,« = 1 Vfc£[l 1 fi],i6[i,-i + U]. (20) 

i=i fc=i 

Proof: It suffices to show that for any < t < 1, tjjfe^ satisfies the conditions in Theorem 
14.3.21 Apparently, we have 

t%,< G [0, 1] (V i, fc) 

and 

i=l fe=l 

From ( 117(1 , for every s > 1, 



£(A, + ^ tr7 fe ,i) < (1 - t) J2 A * < 



i=l fc=l i=l 

We have shown that ( ITl)l holds for j = j s . For j s _i + 1 < j < j s , since jjj^j > 0, 

J n 

i=i fc=i 

i=l fc=l (21) 

<-f> 

i=i 

<-!> 

i=i 

Thus, f ITIJl holds for all 1 < j < p. By Theorem 14.3.21 L(a, 0) is bounded by o _t/i with 
/ife = X)i=i 7 ?M- Hence, L(a, <fi) is weakly bounded by a~ M . Q.E.D. 
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5.2 L(p,n) and Algorithm for a G A + 

Theorem 15. 1.11 only assumes a G [l,oo) n . Suppose from now on 

a G A + = {ax > a 2 > . . . > a n > 1}. 

In order to gain a better control over L(a, 4>), we just need to assign numbers to r\x.i to make 
fix as big as possible, then assign numbers to r?2,i to make fi 2 as big as possible and so on. 
The only requirement is either f I19|) or f l2U|) . Our algorithm can be stated as follows. 

Definition 5.2.1 Fix j s and assume that {rj^i \ i < j s -i} are known. We assign numbers 
between and 1 to r)ki for j s -x < i < j s in the following way. If ( \2U\) holds, assign 
Vk.i — 1 for all k and all j s -x + 1 < i < js- We are done. If ( holds, we choose 
{rjx.i | js-i + 1 < i < js} satisfying and maximizing ^2lLj B _ 1 +x r li,i- The order of 

assigning numbers to for j s -x <i < j s is not of our concern. Update f \iy\) . If ( Mfy) 

is trivial, we assign zero to the rest of {rjk,i \ js-i + 1 < i < js} and stop. If not, choose 
{r/2,i | is-i + 1 < i < js} satisfying ( \iy\) and maximizing YliLj _ 1 +i T )2,i- Update MiA and 
repeat this process. We do this for each j s until we reach i — p. Finally, we compute 

v 

Mfc = ^ rjk,i (l<fc<n) 
i=i 

and obtain a unique /i. Write 

L(p,n)(X) = -/i. 

The domain of L(p, n) are apparently p-dimensional real vectors such that 

A -< 0. 

The range of L{p, n) are n-dimensional real vectors such that 

fx ~< 0. 

L{p, n), in general, does not produce the precise information for the Langlands parameters 
under theta correspondence; but for a special class of representations, L(p, n) will be precise. 
Now, Theorem I5.1.1l can be restated as follows. 

Theorem 5.2.1 Suppose a G A + . Suppose cf>(b)b~~ n+1 on B + is bounded weakly by b x with 
A -< 0. Then the integral L(a, A) converges. Furthermore, L(a, A) is weakly bounded by a M 
for /i = L(p, n)(A). 

5.3 Examples 

Now let us compute a few examples. Suppose p < n. 
Example 1: For 

X = (--,--,...,-p+-), 
L(p,n){\) = (-p+i -p + 1 + -,..., 0,...,0). 

Example 2: For 

A= (-l,-2,...,-p), 
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L(p,n)(X) = (-p, -p+l,...,-l,0,...,0). 

Example 3: For 

A = (--,--,...,-n+-), 

13 1 

L(n,p)(X) = (-n + -,-n + -, ...,-n-- + p). 

Example 4: For 

A=(-l,-2,...,-n), 
L(n 1 p)(\) = (-n, -n+1, . . . ,-n+p - 1). 

6 Dual Pair (0(p, q), Sp2 n (^)) and Estimates on 9 s (tt) 

Let 0(p, g) be the orthogonal group preserving the symmetric form defined by 

/0 P I p 
I P>q = I q - P 
V Ip Op 

and 5p2n(R) be the standard symplectic group. We define a symplectic form on V = 
M{p + q, 2n) by 

£l(vi,V2) — Trace{v\Wv\l Ptq ) (V v\,v 2 G V). 

Now as a dual pair in Sp(V, O), 0(p,q) acts by left multiplication and S'p2n(R) acts by 
(inverse) right multiplication. Wc denote both actions on M(p + q, 2n) by m. 

6.1 The dual pair representation u(p,q;2n) 

Let £jj be the entries in first n columns of v € V and y^j be the entries in the second n 
columns of v. Let 

X = {v eV \ ViJ =0}, Y = {v eV \ Xi j = 0}. 

Then X and Y are both Lagrangian subspaces of (V, f2). We realize the Schrodinger model of 
Mp(V, Q) on L 2 (X). Let g; 2n) be the Harish-Chandra module. We call the admissible 
representation 

(w(p,q;2n),V(p,q;2n)) 

the dual pair representation. 

Now let b — diag(6i, b 2l ■ . . b p , 1, . . . , 1, b^ 1 , . . . , b^ 1 ). Let 

B+ = {b\ h > b 2 > . . . > b p > 1} C 0(p, q). 
Let a — diag(a^ 1 , a^ 1 , . . . , a" 1 , ai, . . . , a n ). Let 

A + = {a | at > a 2 > . . . > a n > 1} C Sp 2n (R). 

For 1 < j < n, let 

biCij i = l,...,p 
m(b)eij = ^ e it j i=p+l,...,q 

K le i,j i = q+i,---,p + q 
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m{a)e it j = dje it j (i = 1, . . . ,p + q) 

These formulae indicate that the embedding m of A and B into GL{X) are simply the left 
multiplication and the (inverse) right multiplication. In fact, 

{hajdj i = l,...,p 
cijeij i = p + 1, . . . , q 
K 1(1 j e i,j i = q+l ) -..,p + q 

Let b(gi) be the middle term of KAK decomposition of g\ with b(gi) £ B + . Let a(g2) be 
the middle term of KAK decomposition of g 2 with 0(^2) G A + . Observe that 

{ha 3 + b^aj 1 )^, + haj 1 ) = (b 2 + bf + a 2 + af). 

From Theorem 13.3.11 we obtain 

Theorem 6.1.1 For any (j>,ip £ V(p,q;2n), 

p n n 

\(co(p, q; 2n)(m(a&))6 VOI < C[[ JJ(h? + bf + a 2 + aj 2 )-? H^j + aj 1 )-^ 

i=l i=l 3=1 

Furthermore, this estimate holds for 771(17152) by substituting b{g{) and 0(172) into the right 
hand side. 

We denote 

p n 
i=lj=X 

by H (a, b). 

6.2 Growth Control on 9 s (p, q; 2n)(7r) 

Let (71", V) be an irreducible Harish-Chandra module in lZ s (p,q;2n). We are interested in 
the following integral 

(<j(p, q; 2n)(g 1 g 2 )(t), ip)(v, ^{g^dgx (u, v £V;ijj,ip £ V{p, q; 2n)). 

MO(p,q) 

Our goal is to control the growth of this integral as a function on MSp2 n (^)- From Theorem 
16.1.11 and Theorem 13.4.11 we may as well consider 

/ X\{a 3 +a^)-^H{a,b)b^\{ d f (22) 
• )b+ j=i i=i 1 

Here p\ is the half sum of the restricted positive roots of 0(p, q): 

= ( P + ( j- 2 p + q-p . 

Pi { 2 > 2 >•••> 2 j 
and (7t((7i)m, u) is bounded by a multiple of 6(gi) A . We observe that 

nh'+S- 1 )^ / H(a,6)6V^n?< C,a (32)^^A + 2p 1 -l) 

j = l i=l 1 

From Theorem 15.2.11 we obtain 
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Lemma 6.2.1 Let n G lZ s (p,q;2n). Suppose K-finite matrix coefficients of it are bounded 
by some Cb{g\) x with 

X + 2p{0{p,q))-n<Q. 
Then the matrix coefficients of 9 S (p, q; 2n) (71") are weakly bounded by 



a(92) 



L(p,n)(\+2p(0( P! q))-n)-'- 



Recall that tt G TZ ss (p, q; 2n) if and only if 



R(«)-(n-E + S)+p(O(p, g ))-<0 
for every leading exponent v of n. Take 

X = n-^±^-p(O(p,q)) + {S,0,...,0) 
with 6 a small positive number. Then matrix coefficients of tt are bounded by multiples of 

b(gi) x . 

L(p,n)(X + 2p(0(p,q))-n) 
=L(p, n)(-2±2 + p(0(p, q)) + (6,0,..., 0)) 

=L(p,n){-l + 5,-2,...,-p) (23) 



r [-p + S,-p+l,...,-l,0,...,0) n>p 
(—p + 5, —p + 1, . . . , — p + n — 1) n < p 

From Lemma 14.1.21 we obtain the following theorem 



Theorem 6.2.1 Suppose that tt G lZ ss (p, q; 2n). Then the matrix coefficients of6 s (p, q; 2n)(7r) 
are weakly bounded by 



/ , f p+q q-p q-p \ 

a(g 2 ) ( 2 ' 2 '-' 2 2 - 1 0/ n>p) 

, , f P + g P + q-2 p + q-2.1+2 -, 

a(c/ 2 ) 1 2 ' 2 '-' 2 j («/ n<p). 
6.3 Growth Control on 6{2n; p, q) s (7 T ) 

Let (7r, V) be an irreducible Harish-Chandra module in lZ s (2n;p, q). We are interested in 
the following integral 

(uj(p,q;2n)(g 1 g 2 )(t),tp)(v,Tr(g2)u)dg2 (u,v G V;^,ip G u(p,q;2n)). 

MS P2n {R) 

Our goal is to control the growth of this integral as a function on MO(p, q). From Theorem 
16. 1.11 and Theorem 8.47 in |15j . it suffices to consider 

/ H(a,b)a x a 2 ^f\(a J +aJ 1 )-^— (24) 
Ja+ fj[ aj 

Here p 2 is the half sum of the restricted positive roots of Sp2n{^-)'- 

p 2 = (n,n- 1,...,1) 

and (7r(<? 2 )w, v) is bounded by a multiple of a(g 2 ) x . Apparently, the integral 1241 can be 
controlled by CL(a, X — — 1 + 2p 2 ). From Theorem 15.2.11 we obtain 
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Lemma 6.3.1 Suppose that n £ lZ s (2n;p,q), i.e., the matrix coefficients of -k are bounded 
by multiples of a(g2) x for some 

X + 2p 2 -*±*^0. 

Then the matrix coefficients of 9 s (2n;p,q)(Tr) are weakly bounded by 

b{g 1 ) L{n > p){x+2p2 - E ¥ L) . 
Recall that the representation tt is in lZ ss (2n;p, q) if and only if 

»(«) + n + 1 + P2 - H±S -< o 

for every leading exponent v of n. Now let 

A = -n-l-p 2 +P±5 + (5,0,...,0) 

where d is a small positive number. Then the matrix coefficients of 7r are bounded by 
multiples of a(g2) x and 

A + 2p2 — = -n - 1 + P 2 + 5 = (-1 + 5, -2, . . . - n). 

Therefore 

L(n,p)(A + 2 P2 - £±5) = (-n + <5, -n + 1, . . . , -1, 0, . . . , 0) (p > n) 

L{n,p)(\ + 2p 2 - -) = (-n + <5,-n + l,...,-n+p- 1) (p < n) 
From Lemma 14.1.21 we obtain 



Theorem 6.3.1 Suppose that tt is inTZ ss (2n;p,q). Then matrix coefficients of 9(2n;p,q) s (jr) 
is weakly bounded by 

6(ffi) (-» 1 -n + l,...,-l,0,..,0) (p > n) 

6 ( ffl )(-n-n+l,...,-n+ P -l) (p < „). 



6.4 Applications to Unitary Representations 

We may now combine our results from |12j with the results we established in the previous 
two sections. Let us start with a unitary representation in TZ ss (p, q; 2n). 

Theorem 6.4.1 Suppose p+q < 2n+l. Suppose n is a unitary representation inlZ ss (p,q;2n) 
and is nonvanishing. Then 9 s (p, q; 2n)(7r) is unitary. Furthermore, the matrix coeffi- 
cients of 9(j>, q; 2n)(ir) is weakly bounded by 

P n — p 
' ^ -' ' > 

p + q p + q-2 q-p q-p q-p 

a(g 2 ) 2' 2 2 ' 2'"'' 2 ) 

In |12| . we have proved that for p + q odd we can loose our restrictions from lZ ss (p, q; 2n) 
a little bit and unitarity still holds for 9 s (p, q; 2ti)(tv). The precise statement can be stated 
as follows. 
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Theorem 6.4.2 Suppose p + q < 2n + 1 and p + q is odd. Suppose ir is a unitary repre- 
sentation in lZ s (p,q;2n) such that each leading exponent v of ir satisfies 

- (n - P + l~ 1 ) + P(0(p, q)) -< 0. 

If * s nonvanishing, then 9 s (p,q;2n)(ir) is unitary. Furthermore, the matrix coefficients 
of 9 s (p,q;2n)(ir) is weakly bounded by 

p n-p 
, * " ,. 

p + q — 1 P+Q— 3 q—p+1 q—p Q—p 

a{g 2 ) ( 2 ' 2 ' ' ' ' ' 2 ' 2~ ' ' ' ' 2~ } 

Similarly, we obtain the following theorem regarding 9 s (2n;p,q)(ir). 

Theorem 6.4.3 Suppose that n < p < q. Suppose that ir is a unitary representation in 
1Z ss (2n;p,q). If (, ) w is nonvanishing, then 9 s (2n;p, q)(n) is unitary. Furthermore, the 
matrix coefficients of 9 s (2n;p,q)(ir) are weakly bounded by 

n p — n 

b( gi )(-n,-n + l,...,-l,0,...,0) 

7 The Idea of Quantum Induction 

In this section, we will define quantum induction first. Then we compute the infinitesimal 
characters of quantum induced representations. Finally, we give some indication how the 
limit of quantum induction will become parabolic induction. 

7.1 Quantum Induction on Orthogonal Group 

Consider the composition of 9 s (p, q;2n) with 9 s (2n;p',q'). Suppose ir € lZ ss (p, q;2n) and 
p + q < 2n + 1. If (, )tt is nonvanishing, then 9 s (p,q;2n)(Tr) is unitary and its leading 
exponents satisfy 

p n-p 
■ ^ ^ ' " > 

„, , , p + q P + q-2 q-p + 2 q-p g-p 
»(«)=<( —, g 2 ' 2 - '-'-~^ -) - 

The representation 9 s (p,q;2n)(Tr) is in lZ ss (2n;p', q') if 

/ "N / " * , . 

, p + q p + q-2 q-p + 2 q-p q-V-,., , a nn.^ P + <1 , n 
( g - , g , • • • , ~ 2 , — ' ■■■ — ) + (n + l)+p(5p2n(R)) ^ — =< 0. 

This is true if and only if 

hn+l + n — < 0. 

We obtain 
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Theorem 7.1.1 Suppose 

q' >p' > n 

p' + q' - 2n > 2n - {p + q) + 2 > 1 

p + q = p' + q' (mod 2). 

Let 7r be an irreducible unitary representation in lZ ss (p, q; 2n). Suppose that (,)■„ does not 
vanish. Then 6 s (p,q;2n)(ir) is unitary and 

6 s (p,q;2n)(ir) E TZ ss (2n;p' ,q'). 

Furthermore, 9 s (2n;p', q')9 s (p, q; 2n)(7r) is either a unitary representation or the NULL rep- 
resentation. 

Definition 7.1.1 Let tt be a unitary representation in TZ ss (p, q;2n) . Suppose that 

q' >p' > n 

p' + q' - 2n > 2n - {p + q) + 2 > 1 
p + q = p' + q' ( mod 2) 

We call 

Q(p,q;2n;p',q') : tt -> 6 s (2n;p', q')6 s (p, q; 2n)(w) 
the (one-step) quantum induction. 

If one of (, ) 7I and (, )e( J ,,< ?; 2n)(ir) vanishes, we define our quantum induction Q(p, q; 2n;p', q')(ir) 
to be the NULL representation. 

7.2 Quantum Induction on Symplectic Group 

Next, we consider the composition of s (2n;p, q) with s (p, q; 2n'). Suppose n < p < q. Let 
7r be a unitary representation in lZ ss (p,q;2n). Suppose is not vanishing. Then the 
leading exponents of 9(2n;p,q) satisfy 

n(v) d (-n,-n+l,...,-l,0,...,0). 

Therefore, 9{2n;p 1 q) is in lZ ss (MO(p,q),u(p,q;2n')) if 

(-n, -n + 1, . . . , -1,0, . . . , 0) - n' + + p{ p{p, q )) < 

This is true if and only if 

-n- n' +p + q - 1 < 0. 

Theorem 7.2.1 Suppose 2n' —p — q > p + q — 2n — 2 and n < p < q. Suppose n is a unitary 
representation in lZ ss (2n;p,q). If (,)„- does not vanish, then Q s (2n;p,q)(ir) is unitary and 
it is in TZ ss (p, q; 2n'). Furthermore, 8 s (p, q; 2n')9 s (2n;p, q)(n) is a unitary representation or 
the NULL representation. 
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Definition 7.2.1 Let p,q,n,n' be nonnegative integers such that 

n < p < q 

p + q-2n-2<2n'-p-q 
Let 7r be a unitary representation in lZ ss (2n;p,q). We call 

Q(2n;p, q; 2n') : ir -> 9 s (p, q; 2n')6 s (2n;p, q)(n) 

the (one-step) quantum induction. 

If one of (, ) w and (, )e s (2n;p,q)(-n) vanishes, we define our quantum induction Q(2n;p, q; 2n')(7r) 
to be 0. Thus the domain of our quantum induction is TZ ss (2n;p,q). 

7.3 Quantum Inductions 

We can further define 2-step quantum induction and so on. The general quantum induction 

Q(pi,qi; 2m;p 2 , <li\ 2n 2 ; . . .)(tt) 

is defined as the composition of 9 S , under the following conditions: 

1. Initial Conditions: 
Pi + qi < 2ni + 1. 

7T is a unitary representation in H 8S (pi, qi\ 2ni), i.e., its leading exponents satisfy 

- m + + P (0( Pl , Ql )) d o 

2. Inductive Conditions: V j, 

rij < pj+i < q j+ i 
Pj+i + qj+i - 2nj < 2n j+1 - p j+1 - q j+1 + 2 
2n 3 - Pj -qj+2< p j+1 + q j+1 - 2n 3 
Pj + qj = p j+1 + q j+1 ( mod 2). 

Theorem 7.3.1 The representation 

Q(pi,qy, 2m;p 2 , q 2 ; 2n 2 ; • ■ -)W 

is either an irreducible unitary representation or the NULL representation. 

The general quantum induction 

Q(2ni;p 1 ,q 1 ;2n 2 ;p 2 ,q2;2n 3 ; . . .)(tt) 

is defined as the composition of 9 S under the following conditions: 

1. Initial Conditions: 
ni <p\< q\ 

7T is a unitary representation in lZ ss (2ni;pi,qi), i.e., its leading exponents satisfy 
»(«) - Pl ^ qi + n + 1 + p(S P 2n 1 (M)) d 
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2. Inductive Conditions: V j, 



rij < Pj < qj 
Pj + qj - 2rij < 2n ]+ i — pj — qj + 2 
2n J+ i - pj - qj + 2 < p j+i + q j+1 - 2n. J+1 
Pj + Qj = Pj+1 + Qj+i ( mod 2). 
Theorem 7.3.2 The representation 

Q(2n 1 ;p 1 ,qi; 2n 2 ; p 2 , 92 5 2n 3 ; . . .)(ic) 
is either an irreducible unitary representation or the NULL representation. 

Our inductive conditions are natural within the frame work of orbit method (see 
E3 > EB) [231 )• The nonvanishing of 9 S has been studied in |5] and It can be assumed 
as a working hypothesis in the framework of quantum induction. Notice that Q is defined 
as a composition of 9 S . Thus, it is not known that Q is exactly the composition of thcta 
correspondences over R. This problem hinges on one earlier problem mentioned by Jian-Shu 
Li (see Q2]): 

Is (, ) 7r nonvanishing if tt G K(MG 1 ,MG 2 ) n 1l s {MGi, MG 2 )1 

Our result in [10| which is derived from Howe's results in confirms the converse: 
7r is in 1Z(MGi, MG2) if (, )tt does not vanish. 
Therefore, if Q(*)(tt) ^ 0, Q(*) is the composition of 0. 

7.4 Infinitesimal Characters 

Infinitesimal characters under theta correspondence were studied by Przebinda ([231)- We 
denote the infinitesimal character of an irreducible representation tt by T(tt) . Przebinda's 
result can be stated as follows. 

Theorem 7.4.1 (Przebinda) 1. Suppose p + q < 2n + 1. Then 

■rial o \t \\ ti \ m t P + 1 P + 1 1 ^ , ^P + 1^ P + 1\ 
l(e(p, q; 2n)(7r)) = I(n) © (n — , n 1, . . . , 1 + [— — } — ). 

2. Suppose 2n + 1 < p + q. Then 

I(6(2n;p, g )(vr)) = I{ir) © (— n - 1, — n - 2, . . . , — [— ^— ]). 

5. Suppose p + q = 2n or p + q = 2n + I. Then X(6(p, q; 2n)(n)) = T(tt). 
Now we can compute the infinitesimal character under quantum induction. 
Corallary 7.4.1 Suppose Q(*)(tt) 7^ 0. 

1 . If p + q is even, then 

I(Q(2n;p, q; 2n')(n)) = I(*)(B(Z±*- n -l, ^-n-2, . . . , 0)®(n'-£±i , n'-^-l, 
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2. If p + q is odd, then 

l(Q(2n;p, q; 2n')(nj) = l^M^-n-l, ^-n-2, . . . , l)e( n >-Z±l, n'-^-l, . . . , \). 

3. If p + q is even, then 

l(Q(p, q; 2n;p>, q')(n)) = T(7r)e(»-^,n-^-l, . . . , l)®(E-t^- n -l, ^-±^-n-2, . . . , 0). 
^. If p + q is odd, then 

1(Q( P , q; 2n;p', q') (tt)) = I^efr-^, n-^-1, . . . , ±)e(£-±^-n-l, ^y^-n-2, . . . , \). 
We shall now take a look at some "limit" cases under quantum induction. 
Example I: p + q + p' + q' = 4n + 2. 
In this case, 

p + q p' + q' 

n ^ — = ^ 71—1. 

2 2 

Therefore, 

In— p— q+1 



Z(Q(p,q;2n;p',q')(-!r)) =Z{v) (n - ^— ^,n- - - n, ^-r-^ - n) . 

Example II: 2n — p — g + 2 = p' + q' — 2n and p — p' = q — q' '. 
Notice first that 

p' - p + q' - q = (p' + q') - (p + q) = An + 2 - 2{p + q). 

Therefore 

p' — p p' — p + q' + q P + 1 1 

= =71 1 

2 4 2 2 

Recall from Prop 8.22 [T5] 

Alndf %^ GLo(j) ,_ p)N {^l)) 
=l(n ® 1) 

— P~ 1 p' — P~ 3 p' — p — 3 p' — p—l. , . 

=l(n)®C—-^ !i | ) (25) 

=J(tt) (n - ^~i^-,n - - 1, • . . , 1 + - n, - n) 

=I(Q(p, q; 2n;p',q')(7r)). 

This suggests that Q(p, q; 2n;p', 9 / )( 7r ) as a representation of SOq(p, q) can be decomposed 
as direct sum of some parabolically induced unitary representation (see Conjecture I). 

Example III: n + n' + 1 = p + q. 
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In this case, 



p + q , , p 

— n — 1 = n — 



2 2 
n' — n — 1 v + Q 



1. 



2 2 
From Prop. 8.22 ( 15 ) and the Corollary, 

J ( /n 4^:«k(n'-n)Jv( 7r ® !)) 

, ,n' — n— In' — n — 3 n' — n — 3 n' — n — 1. 

=X(7r) © ( , , . . . , , ) 

V 1 K 2 ' 2 ' ' 2 ' 2 y (26) 

=I(tt) 8 (— n - 1, — n - 2, . . . , h n + 2, h n + 1) 

=Z(Q(2n;p',( 7 ';2rc')M) 

This suggests that Q(2n;p, q; 2n')(n) can be obtained as subfactors of certain parabolic in- 
duced representation. We prove this connection in |13|. 

Let me make some final remarks concerning the definition of quantum induction Q. Notice 
that Q(p, q; 2n;p' , q')(jr) contains distributions of the following form 



u(p ,q ;2n){gi)(j>x ® / u{p,q- 1 2n) c (g l g 2 )(j) 2 ®'K(g 2 )vdg 2 dgi 
uj(p, q; 2n) c (g 2 )[ \ uj(p' + q, q + p; 2n){g 1 ){(f) 1 ® fa)dgi] ® ir{g 2 )v. 

MO(p,q) JMSp 2n (S.) 

Our discussions in this paper guaranteed absolute integrability of this integral. Notice that 
the vectors in [*] are in 8(2n;p' + q,q + p')(l). 

Definition 7.4.1 Suppose p' + q > 2n, q' + p > 2n and p + q + p' + q' is even. Consider 
the dual pair (0(p' + q, q' + p) , Sp 2n (R)) ■ This is a dual pair in the stable range ( llfrf . JE/)- 
Then 9 (2n;p' +q, q' +p) (1) is an unitary representation of MO (p' +q,q' +p) (see llfrf . \34\ )- 
Let 0(p, q) and 0(p' , q') be embedded diagonally in 0{p' + q,q' + p). Let ir € H(MO{p, q)). 
Formally define a Hermitian form (, ) on 9{2n]p' + q, q' + p)(l) ®7T by integrating the matrix 
coefficients of 9{2n\p' + g, q' +p)(l) against the matrix coefficients of tt over MO(p,q) as in 
fQJ). Suppose that (, ) converges. Define Q(p,q;2n;p',q')(iv) to be 9{2n\p' + q, q' +p)(l) (g> tt 
modulo the radical o/(, ). Q(p, q\ 2n:p', g')( 7r ) * s thus a representation of MO(p' ,<?'). 

One must assume that p 1 + q' = p + q (mod 2). Otherwise, 9(2n;p' + q,q' + p)(l) = 0. Q 
can be regarded as a more general definition of quantum induction. It is no longer clear 
that Q preserves unitarity. 

Theorem 7.4.2 Under the assumptions from Theorem \7.1.1[ 

Q{p, q; 2n;p', q')(n) S! Q(p, q; 2n;p\ q') (tt). 

Similarly, one can define nonunitary quantum induction Q(2n;p, q; 2n')(ir). 

Definition 7.4.2 Suppose that p+q < n+n'+l. Consider the dual pair (0(p, q), Sp 2n +2 
Then 9(p,q;2n + 2n')(l) is a unitary representation of MSp 2n+2n >(M) (see J^/, ]iyf . 
Let tt € Tl(MSp 2n (R)). Formally define a Hermitian form (, ) on 9(p, q; 2n + 2n')(l) ®tt by 
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integrating the matrix coefficients of 0{p, q; 2n + 2n')(l) against the matrix coefficients of tt 
as in Suppose that (, ) converges. Define Q(2n;p, q; 2n')(ir) to be 9(p, q; 2n + 2n')(l)<g)7r 
modulo the radical of (, ). Q(2n;p, q; 2n')(ir) is a representation of MSp2 n (WL). 

For p + q odd, the MSp in this definition are metaplectic groups. For p + q even, the MSp 
in this definition split (see Lemma I3.1.1fl . 

Theorem 7.4.3 Under the assumptions from Theorem \7.2.1[ 

Q(2n;p, q; 2n')M S Q(2n;p, q; 2n')(7r). 
There is a good chance that Q(*)(tt) will be irreducible. 

Quantum induction fits well with the general philosophy of induction. On the one hand, 
similar to parabolic induced representation IndpT whose vectors are in 

Hom P (C?(G),T), 

quantum induced Q(p, q; 2n;p', q')(ir) li es m 

Hom 0{Ptqho{p)xO(q) (9(2n;p' + q,q' +p)(l),ir). 

On the other hand, IndpT has a nice geometric description. It consists of sections of the 
vector bundle 

Gxpr^G/P. 

In contrast, quantum induction does not possess this kind of classical interpretation except 
for some limit case. 
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